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[57] ABSTRACT 

A method for enhancing lofargram data images utilizing 
a rule base. The system takes a plurality of sequentially 
occurring vertical frequency strips of a lofargram data 
image and computes an estimate for the mean and vari- 
ance of each vertical frequency strip. A linear transfor- 
mation utilizing a rule base is then applied to each pixel 
of the vertical frequency strip to improve the visual 
clarity of the lofargram data image. 

15 Claims, 8 Drawing Sheets 
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variance of each block using a rule-based expert system. 

METHOD FOR LOFARGRAM IMAGE The enhanced individual block images are then recom- 

ENHANCEMENT bined into a high-quality output image, based on a 

TECHNICAL FIELD 5 Q^^<^^««^^ «^ 

The use of presently existing localized image en- 
This invention relates to image enha ncement tech- hancement techniques is limited to visual imagery and is 
niques, and more specifically to a method for enhancing not ^ftj ^th a different kind of image such as a lofar- 
lofargram image data. gram. As used herein, 'lofargram" refers to low fre- 

BACKGROUND OF THE INVENTION 10 quency analyzing and recording gram data. Further- 
Image enhancement encompasses techniques for im- more > use of a Gaussian technique for the recombi- 
proving the visual quality of an image for a particular nation of enhanced image blocks is slower than might 
application. Image enhancement techniques are broadly otherwise be accomplished utilizing a different type of 
applied to various types of images. Examples of this method. 

would include histogram modification of x-ray images 15 Thus, a need has arisen for a image enhancement 
to improve their visual quality, gray-scale correction of system capable of operating upon the different informa- 
aerial photographs to promote clarity and smoothing, ^ on contained within a lofargram, to recombine the 
or sharpening operations of photographs to improve mdividuall y enhanced image blocks in a technique 
^ reduce noise and promote visible signals or ^ faster ^ presently existing methods ^ to ^ ^ 

^Various types of image enhancement techniques are vanta S e of different formation content of a lofar- 
presently employed. One method is image-contrast ma- &*m compared to a visual image, 
nipulation, a technique for modifying image contrasts SUMMARY OF THE INVENTION 

such that low-contrast areas are enhanced to achieve a 

more desirable contrast Thus, weak image signals are 25 The method and apparatus of the present invention 
converted into clearer visible information. The degree overcomes the foregoing and other problems associated 
of contrast modification carried out on any particular with the prior art by using a modified rule-based 
image is a function of a contrast modification character- method for enhancing lofargram images. The purpose 
istic curve. of the present invention is to provide a gray-scale map- 

Lmear-mean invariant transformation is another 30 ping of lofargram data enhancing it in such a way as to 
method wherein by mathematics modeling and algo- ^ of more readfl ^le and distin- 

nthm implementation, the contrast modification charac- .fT u i , . . 

teristic curve is simplified by linear-mean invariant S™^* from background noise and to display more 
transformation. The benefits of linear-mean invariant clearl y ^ stnicture of the signals for better character- 
transformation include: (1) a simplified linear transfer- 35 ization. The system will accept lofargram data and 
mation of the curve; (2) the original image mean and carry out an estimation process wherein the mean value 
variance can be calculated; (3) the newly calculated and variance value of the frequency data within a lofar- 
mean-invariant may be given any desirable values; and gram are computed as a function of frequency for a 
i (4) once the old and new mean and variance are known series of vertical strips covering the lofargram image. A 
I the image can be enhanced according to the algorithm. 40 second operation is the actual image enhancement 
Histogram equalization flattens the image histogram wherein a linear transformation of each pixel within the 
to obtain a uniformly bright output image. The equal- vertical ^ coverillg the lofargram sample is per- 
T^tT* m ^ mathematical fomccL ^ ^^ents of the Iinear transformation 

expression. are determined from a rule-base acting on the mean and 

45 variance of the vertical strip from which the pixel was 
= Ttq [£fX*)l taken. The transformed data is then output as an en- 

r k _ x -1 hanced lofargram image. 

= 256 2 SKp) + m*m 

b>=° J BRIEF DESCRIPTION OF THE DRAWINGS 

50 

where- For a more complete understanding of the present 

Hi(k)=the histogram of the input image; invention and the advantages thereof, reference is now 

Ho(k)=the histogram of the output image; made to *ke following detailed description taken in 

T^=the transformation for the histogram equaliza- conjunction with the accompanying drawings in which: 
tion. 55 FIG. 1 is a flow chart illustrating the general method 

Histogram equalization makes the occurrence of each of the present invention; 

possible gray level equally likely. Thus, the enhanced FIGS. 2a and 2b are an illustration of a lofargram and 
image will have a uniform brightness distribution. the samples taken of the lofargram as required by the 

All of the previously discussed image enhancement present invention; 
techniques are based upon global information over an 60 3A ^ 3B ^ a flow ^ Mustrating one 

entire image. However, when an input image has strong method for detenninin ^ ffiean average of a vertical 
spatially dependent variation in image illumination, . . & 0 

these image enhancement techniques cannot obtain high equency strip, 

quality output images. Thus, localized image enhance- FIGS * 4A and 4B is a flow chart illustrating one 
ments techniques have been developed to deal with this 65 method for determining the mean squared average of a 
problem. Localized visual imagery enhancement tech- vertical frequency strip; and. 

niques have been utilized which divide a visual image FIGS. 5A and 5B is a rule based table used to accom- 
into a series of blocks and then determines the mean and plish the linear transformation of the lofargram samples. 
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DETAILED DESCRIPTION OF THE 
INVENTION 

Referring now to the drawings, and more particu- 
larly to FIG. 1, there is shown a flow diagram illustrat- 
ing the general method for lofargram enhancement of 
the present invention. Initially a stream of lofargram 
image data 2 is segmented at step 3 into a number of 
vertical frequency strips covering the entire frequency 
range of a lofargram image. Next, an estimation process 
determines at step 4 the mean and variance of the fre- 
quencies within each vertical frequency strip. The esti- 
mation process will be more fully discussed with re- 
spect to FIGS. 2a through 4. 

A rule base is utilized at step 5 to enhance the lofar- 
gram image data contained within each frequency strip, 
i This is achieved by using the rule base to convert the 
I old mean and variance for the frequency strip into a 
inew, enhanced mean and variance. The new mean and 



strips 10 takes place is a fixed value. The integration 
width M varies according to the resolution mode of the 
lofargram 2. The values of M corresponding to a partic- 
ular resolution mode are listed below: 



10 



Resolution Mode 


Integration width 


Broadband 


64 


Broad Vernier 


128 


Vernier 


256 


Super Vernier 


512 


Super Super Vernier 


1024 



The mean and mean squared frequency values at each 
15 time (t) determined from equations (1) and (2) are indi- 
vidually averaged according to equations (3) and (4) to 
achieve the mean and mean squared value for a vertical 
strip 10. The mean and mean squared values of a verti- 



cal strip 10 are determined by averaging the frequency 
ice are used to detennine at step 6 a scaling and a 20 va * ues determined at each time (t) for the vertical strip 
" " " * " determined in equations (1) and (2). 



sing factor for the frequency strip, that enhances the 
J strip to a visual range more easily viewed by the human 

ijeye. Using the scaling and biasing factors from sur- 
rounding vertical frequency strips, the scaling and bias- 
ing for each pixel within a vertical frequency strip may 25 
be interpolated at step 7. The procedures carried out in 
steps 5 through 7 are generally referred to as the en- 
hancement operation. The enhanced frequency strips 
are then stitched back together at step 8 providing a 
complete, enhanced lofargram image. 30 

The estimation process will now be more fully dis- 
cussed with respect to FIGS. 2a and 2b. FIG. 2a repre- 
sents a lofargram data image 12. The image is a fre- 
quency versus time representation of data output from a 
spectrum analyzer. Such images are utilized in sonar 35 
detection devices to record sound frequencies detected 
over time. The lofargram 12 is a visual representation of 
the detected frequencies over time. Initially, as illus- 
trated in FIG. 2b, a series of vertical strips 10 are de- 



n - n£n) 



1 

n - nM 



2 , , «/**) 



(3) 



(4) 



Where: 

u 5 (njc)=mean frequency value of a vertical strip; 
z s (n,k)=average frequency value of a vertical strip; 
no(n)=L-int {n/L}— L; and 
L is the minimum integration length. 
The solutions of equations (3) and (4) are used to 
determine the variance strip estimate. 



(5) 



Referring now to FIGS. 3A, 3B, 4A and 4B, there are 
fined covering the bandwidth of the lofargram 12. The 40 flow charts illustrating one method for calculating the 
vertical strips 10 are defined to cover frequency inter- * - - 



vals k each of length M for an individual time slice. 
During the estimation process, the mean and variance of 
the frequencies of the lofargram 12 within the vertical 
strips 10 are computed and updated sequentially in time. 45 

For each vertical strip 10 the mean and variance of 
the frequency are determined in the following manner. 
A vertical strip 10 is sampled at a plurality of times (t) 
covering the integration width M of the vertical strip 
10. For each of these samples, the mean and mean 50 
square of the frequencies occurring at the sample time 
(t) for the vertical strip 10 are determined according to 
the following equations: 



»/<**) = ~k- .\, Piruj) 
M j=Mk 



(0 55 



2/in.k) * 



Mk+M- 1 , 
J=Mk 



(2) 



Where: 

M=the integration width; and 
k= average of individual frequency intervals; 
u/= the mean frequency value at the time (ft 
Z/=the mean square frequency at time (t) 
P(nj)= frequency value of the lofargram. 
The bandwidth k over which the determination of the 
mean and mean square of the frequency for the vertical 



60 



65 



mean and mean square of the frequency within a verti- 
cal frequency strip 10. The described method would 
utilize a processing unit (not shown) containing a num- 
ber of counter and accumulator registers to carry out 
the described method. For ease of description the refer- 
ence numbers within FIGS. 3 and 4 are identical, as the 
methods for determining the mean and mean squared 
are the same. 

First counter registers Ii and I2 and accumulator reg- 
isters Ai and A2 within the processing means (not 
shown) are initialized as shown at step 20. The mini- 
mum integration length L, is 240 scans lines. The lower 
limit of integration moves in discrete steps of length L 
so that the total integration interval varies between L 
and 2L. The first L=240 scans lines are handled sepa- 
rately from the general case. Ax, represents the average 
obtained there. A mean value calculated according to 
equation 1 is input at step 22. Upon receipt of a mean 
value, counters Ii and I2 are both incremented by one. 
Comparison step 26 determines if counter Ii equals 
twice the integration length. If so, counter register Ii 
and accumulator register Ai are cleared and reset to 
zero. Comparison step 28 determines if counter register 
Ii equals twice the integration length: If so, the counter 
register I2 and accumulator register A2 are reset to zero 
at step 29. 

The mean average in accumulator registers Ai and 
A 2 are updated at step 30. The update is performed by 
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determining constant values Q and C2, as shown at step variance value. The scaling and offset factors are calcu- 

30, and then updating the mean average values in accu- lated according to the equations: 
mulator registers Ai and A2 using the constant values 

and the present mean value at time (t). A comparison is ^ 

made at step 32 to detennine if Ii is greater than I2. If 1 1 5 a(u. v) = N v Bev Xu.v)/v 
is greater than I2 the mean average is set equal to the 

value in accumulator register Ai. Otherwise, the mean ^"- v ) - - « (8) 

average is set equal to the value in accumulator register 

A2. Inquiry step 38 then checks for additional values of Where: 

tyand control passes to step 22 if additional values exist 10 U nw == transformed mean value for a pixel; 

If no further values exist, the mean average for a verti- V„ w = transformed variance value for a pixel; 

cal strip is the existing value of u/ The calculation of the A(u,v) is the scaling factor; 

mean squared average is illustrated in FIGS. 4A and 4B B(u,v) is the offset factor; 

and follows exactly the same procedure as described u is the interpolated mean of the pixel; and 

with respect to FIGS. 3A and 3B except that the mean 15 v is the interpolated variance of the pixeL 

squared value is used instead of the mean value in deter- FIGS. 5A and 5B illustrates a rule base table for 

mining the mean squared average. The variance is then performing linear transformations. The table contains 

determined from the mean and mean squared averages the coded slope and intercept data describing the piece* 

as described in equation 5. wise linear functions for the transformed mean Unew and 

Once the variance and the mean frequency values are 20 variance V ff€W values. The table of FIG. 5 and the fol- 

determined for the vertical strips 10, the enhancement lowing equation are used to determine the enhanced 

procedures of steps 5 through 7 utilize a rule based table mean and variance values: 
to enhance the pixels 11 within the vertical strip 10. 

Enhancement is accomplished by applying a linear Unew— Cj (/„/>« 4- C2( /,./) (9) 

transformation to the gray scale value (P) of each pixel 25 

11 within a vertical strip 10. The pixel 11 is transformed f^^t+j^ <10) 

to a more visible range and a new gray scale value TT . A , . A , 4 , . , r 

OW for the pixel is created by multiplying the previ- . U f£ ^emterpolated mean and variance values for a 

ous pixel gray scale value by a scaling factor A to in- ^ r^t ?. 2 ^ 

crease the variations between the visible elements of the *> mmed ficoi ° ™ e <^ GS 3A ^3B).Trus 

pixel and then adding an offset factor B that biases the 15 »oriplBhed by choosing the row containing the 

gray scale value of the pixel up or down to achieve an ™& ******* ™ value of the pixel 11 and the 

intermediate visual range more easily seen by a viewer. column contammg the range mcludmg the variance 

The general transformation is illustrated by the follow- Yf 1 ^ of L the ^ ™* coeffiaent values C u C 2 , D 2 and 

35 D2 are thus easily found. The values of V new and Vj 



new 



mg equation: 

are determined and substituted into equations (7) and (8) 
p ne ^={p-u)A{u t p)+»+5(«-f) (6) to determine the scaling and offset factors for the linear 

transformation equation (€). The scaling and offset fac- 
The linear transformation scaling factor A and trans- tors are substituted into the linear transformation equa- 
formation offset factor B are determined according to a 40 tion (6) to generate the necessary linear transformation 
rule base that provides enhanced values for the mean of the lofargram pixel. This same process is repeated for 
and variance and produces a value for ¥ new in a desired each pixel within a vertical strip 10. The linear enhance- 
viewing range. The rule base can be implemented in a ment according to a preestablished rule base enhances 
number of fashions and is coded to suit the needs of a the samples of the lofargram image by placing them in 
particular application. 45 a more easily viewed visible range. The rule base fur- 

In one rule base embodiment illustrated in FIGS. 5A ther provides for smooth transitions between the pixels 
and 5B t the parameters A and B are determined from a of the vertical strip 10. 

7 X 7 rule base table containing coefficients for calculat- In an alternative embodiment, a more efficient ap- 
ing the parameters A and B in a piece-wise linear man- proach is to use the frequency mean and variance calcu- 
ner over the span of u and v for each pixel in a vertical 50 lated for a vertical strip to access the rule base and find 
strip 10. The mean and variance values for a pixel the offset and scaling parameters for each strip mean 
within a strip are interpolated from the vertical strip and variance instead of interpolating the mean and vari- 
mean and variance estimates around the pixel The in- ance for each pixel. The offset and scaling parameters 
tervals into which the mean u and the variance v are may then be interpolated for each pixel from the offset 
divided are listed below: 55 and sealing parameters of adjacent vertical frequency 

strips. Thus, the rule base needs to be accessed only 
1/Nth as many times where N is the frequency strip 
width. 

The scale factor A and offset B for each frequency 
60 strip k at each time slice n are defined as follows: 



Interval 


Mean 


Interval 


Variance 


Number 




Number 




1 


0-30 


1 


0-100 


2 


30-60 


2 


100-1000 


3 


60-90 


3 


1000-2000 


4 


90-165 


4 


2000-3000 


5 


165-195 


5 


3000-6000 


6 


195-225 


6 


6000-8000 


7 


225-255 


7 


SOOO^above 



(II) 



65 £{n,r) = CMofe*), - «M) (12) 



The table allows the scaling factor A(u,v) and the A simplification to the basic transformation of equa- 
offset factor B(u,v) to be determined for any mean and tion (6) is also used: 
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(P - w)A + u + B 
P.A + {u + B-uA) 
PA+T 



(13) 



The simplified offset T is computed for each strip and 
is equal to: 



(14) 10 



The scale factor A and simplified offset term T, as 
determined for each frequency strip, are interpolated to 
get a scaling factor a and offset t for each pixel within a 
vertical strip 10, according to the equations: 



15 



o(*m)=atf(n,fc£)+(l -a^Jkjy) 



05) 
(16) 



Where: 
a=(MK//-M)/M; and 
(l-a)=(M-MKi)/M 

Finally the pixel is updated according to the transfor- 
mation: 



20 



25 



(17) 



35 



40 



When all of the pixels are enhanced within all of the 
vertical strips, the strips are stitched back together to 30 
create a lofargram image to a user in a more easily 
viewable form. 

Although a preferred embodiment of the invention 
has been illustrated in the accompanying drawings and 
described in the foregoing Detailed Description, it will 
be understood that the invention is not limited to the 
embodiment disclosed, but is capable of numerous rear- 
rangements and modifications of parts and elements 
without departing from the spirit of the invention. 

I claim: 

1. A method for enhancing a gathered lofargram data 
image comprising the steps of: 

segmenting the gathered lofargram data image into a 

series of vertical frequency strips, each frequency 45 

strip including a plurality of pixels; 
determining a mean and variance for the frequencies 

in each vertical frequency strip; 
adjusting the visibility of the pixels in each vertical 

frequency strip according to the determined mean 50 

and variance to generate a plurality of transformed 

vertical frequency strips; and 
recombining the transformed vertical frequency 

strips into an enhanced lofargram data image. 

2. The method of claim 1 wherein the step of adjust- 
ing comprises the step of adjusting a gray scale value of 
each pixel, including the steps of: 

determining a scaling factor for the pixel from the 
determined variance; 

multiplying the gray scale value of the pixel by the 
scaling factor to increase the variations between 
visible elements of the pixel; 
.detennining a biasing factor for the pixel from the 
determined mean; and 

adding the biasing factor to the gray scale value of 
the pixel to move the gray scale value to an inter- 
mediate viewing range. 



3. The method of claim 2, wherein the step of deter- 
mining the scaling factor for each pixel comprises the 
steps of: 

accessing a rule base using the determined mean and 
variance of each vertical frequency strip to deter- 
mine a scaling factor for each vertical frequency 
strip; and 

interpolating the scaling factors of adjacent vertical 
frequency strips to determine the scaling factor for 
the pixel. 

4. The method of claim 2, wherein the step of deter- 
mining a biasing factor for each pixel comprises the 
steps of: 

accessing a rule base using the determined mean and 
variance of each vertical frequency strip to deter- 
mine a biasing factor for each vertical frequency 
strip; and 

interpolating the biasing factors of adjacent vertical 
frequency strips to determine the biasing factor for 
the pixel. 

5. A method for enhancing lofargram data images 
comprising the steps of: 

segmenting a gathered lofargram data image into a 
series of vertical frequency strips, each strip includ- 
ing a plurality of pixels; 
determining a mean of the frequency for each vertical 

frequency strip; 
determining a variance of the frequency for each 

vertical frequency strip; 
determining a pixel scaling factor from the deter- 
mined variance; 
modifying a gray scale value of each pixel with the 

pixel scaling factor; 
determining a pixel biasing factor from the deter- 
mined mean; 

modifying the gray scale value of each pixel with the 

pixel biasing factor; and 
recombining the vertical frequency strips with the 
modified pixels into an enhanced lofargram data 
image. 

6. A method for enhancing lofargram data images, 
comprising the steps of: 

gathering a lofargram data image; 
segmenting the lofargram data image into a plurality 
of frequency strips, with each frequency strip in- 
cluding a plurality of pixels, and with each pixel 
having a gray scale value; 
detennining, for each of the plurality of frequency 
strips, a mean and variance of the frequencies 
within each frequency strip; 
adjusting the gray scale value of each pixel in each of 
the plurality of frequency strips in accordance with 
the determined means and variances to generate a 
plurality of transformed frequency strips; and 
combining the plurality of transformed frequency 
strips to produce an enhanced lofargram data im- 
age. 

7. The method as in claim 6 wherein the step of ad- 
60 justing comprises the steps of: 

scaling the gray scale value of each pixel; and 
biasing the gray scale value of each pixel. 

8. The method as in claim 7 wherein the step of scal- 
ing comprises the step' of multiplying the gray 1 scale 
value of each pixel by a scaling factor determined from 
the means and variances of the frequency strips. 

9. The method as in claim 7 wherein the step of bias- 
ing comprises the step of adding an offset factor deter- 
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mined from the means and variances of the frequency combining the plurality of transformed frequency 

strips to the gray scale value of each pixel strips to produce an enhanced lofargram data im- 

10. The method as in claim 6 further including the age. 

step of applying a rule base to determine from the means 12. The method as in claim 11 wherein each pixel has 

and variances the adjustment made to the gray scale 5 a gray scale value and the steps of increasing and adjust- 

value of each pixel. ing respectively comprise the steps of: 

11. A method for enhancing lofargram data images, scaling the gray scale value of each pixel; and 
comprising the steps of: biasing the gray scale value of each pixel. 

gathering a lofargram data image; 13. The method as in claim 12 wherein the step of 

segmenting the lofargram data image into a plurality 10 scaling comprises the step of multiplying the gray scale 

of frequency strips, with each frequency strip in- value of each pixel by a scaling factor determined from 

eluding a plurality of pixels; the means and variances of the frequency strips. 

determining, for each of the plurality of frequency 14. The method as in claim 12 wherein the step of 

strips, a mean and variance of the frequencies biasing comprises the step of adding to the gray scale 

within each frequency strip; 15 value of each pixel an offset factor determined from the 

generating a plurality of transformed frequency strips means and variances of the frequency strips, 

from the determined means and variances by: 15. The method as in claim 11 further including the 

increasing variation between the visible elements of step of applying a rule base to determine from the means 

each pixel; and and variances the increases and adjustments made to 

adjusting the visibility of each pixel into a desired 20 each pixel. 

viewing range; and * * * * * 
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